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We consider ensembles of trajectories associated with large deviations of time- integrated 
quantities in stochastic models. Motivated by proposals that these ensembles are relevant for 
physical processes such as shearing and glassy relaxation, we show how they can be generated 
directly using auxiliary stochastic processes. We illustrate our results using the Glauber- 
Ising chain, for which biased ensembles of trajectories can exhibit ferromagnetic ordering. 
We discuss the relation between such biased ensembles and quantum phase transitions. 

§1. Introduction 

This article is concerned with ensembles of trajectories (time-realisations) of 
stochastic model systems, in which we impose constraints on time-integrated quan- 
tities. For example, one might consider an system coupled to two particle reservoirs 
over a time period t, and insist that the total current through the system takes a 
given valueP Such ensembles underlie a range of general results in non-equilibrium 
systems^"® and have been used to investigate transport properties in simple models 
and specific non-equilibrium steady states.^® Recently, they have also been em- 
ployed in studies of the glass transition QSHH) where adjusting constraints on such 
ensembles can drive ergodic 'model fluids' into non-ergodic states that resemble 'ideal 
glasses'. 

The language of ensembles and constraints indicates that our methods will be re- 
lated to those of equilibrium thermodynamics. The crucial difference is that we con- 
sider constraints on time-integrated quantities, while thermodynamics is concerned 
with constraints that apply at all times in a system. While these definitions may 
sound similar, they typically lead to quite different behaviour. To understand this 
difference in a qualitative way, we observe that macrostates in constrained thermo- 
dynamic systems may be obtained by minimising the free energy, which corresponds 
to a minimisation of the work required to introduce the macroscopic constraints. 
On the other hand, when time-integrated quantities are being constrained, one must 
instead minimise a 'dynamical free energy' that corresponds to the power required to 
maintain the constraints, in the face of thermal fluctuations.^ For a constraint on a 
given quantity, minimising the work and the power are not equivalent: to minimise 
the dissipated power, it is preferable for the system to enter states from which spon- 
taneous relaxation to equilibrium is very slow, even if the work required to generate 
such states is relatively large. For example, we show below that in a Id Ising chain, 
the power required to stabilise low energy states is minimised if the system devel- 
ops ferromagnetic order, while the work required to attain the same instantaneous 
value of the energy is minimised by a paramagnetic state - after all, constraining the 
energy to low values corresponds to considering low temperature, which in Id only 
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ever produces paramagnetic states. 

Thus, the ensembles of trajectories that we consider here are not straightfor- 
wardly related to thermodynamic ensembles. Nevertheless, studies of the glass tran- 
sition^'^ and of boundary-driven sheared systems® have proposed that ensembles 
of trajectories generated in this way are relevant for the results of physical experi- 
ments. Establishing a connection between constrained ensembles of trajectories and 
experimental systems is a complicated task. For example, the most natural represen- 
tation of the constrained ensemble does not have a Markov form for the transition 
rates. Further, causality may be broken, in the sense that applying a perturbation 
at time t w may incur a response at times t < t w . Here, we describe some general 
features of such constrained ensembles of trajectories, aiming to understand what 
physical protocol might lead to the same behaviour as a constraint on a time-averaged 
quantity. 

Our results are organised into two sections. In Section [21 we review some general 
aspects of the large deviation formalism that we will use, and we define an 'auxiliary 
model' that is a Markov stochastic process whose steady state trajectories are close 
to those of the constrained ensembles (in a sense discussed below). A similar result 
was described by EvansP we show how the rules discussed in that work can be 
derived through a similarity transformation between master operators for stochastic 
processes. For cases where the constrained ensemble of trajectories is time-reversal 
invariant, the auxiliary model can be obtained though a modification of the energy 
function for the original model. We discuss the extent to which these auxiliary 
models represent physical realisations of the constrained ensembles described above. 
Then, in Section [3j we investigate spontaneous breaking of ergodicity in constrained 
ensembles of trajectories, for the (one-dimensional) Glauber-Ising chain. Despite 
its Id nature, constraining ensembles of trajectories in this model may induce long- 
ranged order and spontaneous symmetry breaking. The mechanism is identical to 
that behind quantum phase transitions, where real time in the stochastic model plays 
the role of imaginary time in a path integral representation of the density matrix. 
We discuss the interpretation of the auxiliary stochastic model in this context. 

§2. Biased ensembles of trajectories 

2.1. Definitions 

We consider stochastic models in continuous time. A model is defined through a 
(discrete) set of configurations {C\,C2, ■ ■ ■ } and stochastic transition rates W(C — > 
C). Then, if p(C, t) is the probability of finding the system in configuration C at time 
t, the master equation of the model is 

§- t p(C,t) = -r(C)p(C,t) + W(C -+ C)p(C',t) (2-1) 

where r(C) = Ylc'^C W(C — > C) is the escape rate from configuration C. Writing 

l-f(^)) = YlcP(C>t)\C)' the master equation can be written as Jj|-P(i)) = W[P(£)) 
where the matrix elements of the operator W are simply (C\W\C) = W(C C) — 
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5c,c>r(C). 

We consider large deviations of time-integrated quantities of the form 

Bt= I dt'B(t') (2-2) 
J o 

where B{t) is an observable that depends only the configuration of the system at 
time t. (In Section O we will take B(t) to be simply the energy of the system.) 
Alternatively, one can consider large deviations fluxes or dynamical activities. That 
is, assume that an observable At acquires contributions whenever the system changes 
configuration: if the sequence of configurations in a trajectory is Cq,Ci, . .. ,Ck then 
At can be written in the form 

K-l 

A t =^a{C k ,C k+l ). (2-3) 

k=0 

For example, one might take a(Ck,Ck+i) = 1 for all pairs of distinct configurations, 
so that At counts the number of configuration changes between time and time 
^JTDJJTT} Alternatively, one might take a(Ck,Ck+i) to be the contribution of the 
stochastic transition C k — > Cfc+i to a total current P accumulated shear,® entropy 
current,® or dynamical entropyP® For convenience, we concentrate on observables 
of the form Bt, but most of our results generalise straightforwardly^ 1 >E3> to time- 
extensive observables of the form At- 

Following the discussion in the introduction, we are interested in ensembles of 
trajectories where Bt is constrained to be far from its average value {Bt)o, where (-)o 
indicates an average in the steady state of the stochastic model. However, it is conve- 
nient to exploit an equivalence of ensembles in the spirit of micro canonical/canonical 
equivalence in statistical mechanics: instead of a constrained ensemble, we define a 
'biased ensemble' by assigning to each trajectory tt a probability that depends on a 
'biasing field' g: 

P[n, g] = Z(g, t)~ l P[,r, 0] exp [-gB t ] (2-4) 

where P[tt, 0] is the probability of observing trajectory ir in the (unbiased) steady 
state of the stochastic model and 

Z(g,t) = (ex V [-gB t ]) (2-5) 

is the partition function for the new ensemble. Our formalism and notation closely 
follows Ref. [T4"|) . and we refer to that paper for further technical details. We note 
that the field g was denoted by s in Refs. fTTj) - ll4p . and the resulting biased ensembles 
accordingly referred to as s-ensembles. We prefer g in this article to avoid confusion 
with Ising spins Sj in later sections. Averages within the biased ensemble are given 
by 

(O) g = Z(g,t)- l (Oexp[-gB t ]) (2-6) 

where O may be any trajectory-dependent observable, and the average depends 
implicitly on the time t as well as on g. 
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From a mathematical point of view, one may identify Z(g, t) as the generating 
function for the moments of Bt- Physically, we note that the effect of g is to bias the 
average (Bt) g . Then, we appeal to equivalence of ensembles: the ensemble defined by 
(|2-4p is equivalent to an ensemble in which B% is constrained to take the value {Bt) g , 
where equivalence holds in the same sense as for the canonical and microcanonical 
ensembles in statistical mechanics. 

Finally, we obtain the 'dynamical free energy' of the biased ensemble. Let p ss (C) 
be the probability of observing configuration C in the (unbiased) steady state of the 
original model. Then, one may write^ 



Z{g,t) = (e\e^ t \s S ) (2-7) 
where {e\ = ^2 C (C\ is a projection state, |ss) = ^2c P &S (C)\C) , an d 

W(g)=W-gJ2\C)(C\b(C) (2-8) 
c 

where b(C) is the value of the observable B in configuration C. Assuming for conve- 
nience that the original stochastic model is irreducible and has a finite state space, 
one makes a spectral decomposition of W(g) = Yli \ Vi)<^i{Ui\, and it follows from 
(|2-7p that the dynamical free energy i^ES 

4>(g) = — lim t~ l log Z(g,t) = -maxw,. (2-9) 

t— >oo ' i 

We note that while we assumed an irreducible model and a finite system, these are 
not necessary for (|2-9|) to hold. However, infinite systems with spontaneously broken 
ergodicity^ 1 '^ 1 or absorbing states^ 1 require some additional assumptions on the 
operator W(g). 

If we wish to consider the large deviations of observables At defined as in (|2-3|) , 
the analysis is very similar: Equs. f|2-4|) - (|2-9|> still hold, with Bt simply replaced by 
At- However, the operator W(g) has a different form in this caseP^'^ its matrix 
elements are 

(C\W(g)\C) = | W ^ C >- 9a(C '' C) > C * p (240) 

2.2. Time-translational invariance, and an auxiliary stochastic process that gener- 
ates the biased ensemble 

We now turn to physical features of the biased ensemble of (|2-4p . Averages (O)o 
in the steady state of the stochastic model are clearly time-translational invariant. 
However, this invariance is broken for observables such as (0) g . For example, if one 
takes a configuration-dependent observable F, averages such as {F(t')) g may depend 
on t' since the bias in (|2-4|) breaks time-translation invariance (TTI). However, as 
long as the operator W(g) is not at a critical point (in a sense defined below), we 
have 

(nt)) 9 -< p f = t>>r (2-n) 
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where r is a relaxation time into the TTI regime, discussed below. In general, the 
biased ensembles are TTI for a range of times t' such that r<t' and r <C t — t'. 

To understand the TTI regime in more detail, we consider the operator W(g). 
This operator is not Hermitian, so it has separate left and right eigenvectors as- 
sociated with its largest eigenvalue, which we denote by (U\ = ^ c (C|w(C) and 
\V) = Ylc v (C)\C) respectively. (We normalise such that (e\V) = 1 = (U\V). This 
is possible since the u(C) and v(C) are non-negative, as will become clear from the 
probability interpretation derived below.) Then, for long times t', we have 



3 W(s)t' _ p-VfoX 1 



V)(U\ + 0(e- Awt ') , (2-12) 



where Auj is the difference between the largest and second-largest eigenvalues of 
W(p). If we restrict to irreducible stochastic models with finite state spaces then 
Auj > and we identify r = (Z\w) _1 . However, in the limit of large system size, Auj 
may vanish. In some cases, this signifies a critical point for the operator W(g), while 
in other cases, the analysis of this section may be generalised and the TTI regime 
still exists. Examples of both cases are discussed in Section 
In any case, one has from (|2- 1 1 j) that 



= lim (ele^X'-^p^V)^*)- 1 (2-13) 

t— >oo 

F { = lim(e|Fe w ^*|ss)Z((7,t)- 1 (2-14) 

t— >oo 

where F = ^ c \C){C\f(C), with f(C) being the value of observable F in configuration 
C. Then, as long as the corrections in (|2-12p are small, one hasZ(g,t) = e"^^* (C/|ss) 
and so 

Foo = (U\F\V) = f(C)u(C)v(C), Ft = (e\F\V) = ^ f(C)v(C) (2-15) 
c c 

Taking then F to be simply an indicator function for configuration C, one sees 
that the probability of observing this configuration in the TTI regime of the biased 
ensemble is 

p TT1 (C) = u(C)v(C), (2-16) 

while the probability of observing the same configuration at the final time t is simply 
v(C). Indeed, as t' is reduced from t, (F(t')) g decays exponentially from Ff to F^, 
on a time scale r = {Auj)~ 1 . 

We now construct an auxiliary stochastic model whose (unbiased) trajectories 
coincide with those of the biased ensemble of (|2-4p . within the TTI regime. We will 
show that, in terms of the diagonal operator U = Y2c \C)(C\ u (C)i the- master operator 
of this auxiliary model is 



UVr^U^+iPig). (2-17) 



The off-diagonal matrix elements of this operator must then be the transition rates 
between the configurations of the system. For biased ensembles defined as in (|2-4|) . 
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these rates are 

r ux (C C) = (C|W aux |C'> = u(C)W(C -> C)— ^— , (2-18) 

u(C) 

which are non-negative as they should be. The model is also stochastic: ^ c (C|W aux = 
(e|W aux = which follows since (U\ = (e\U is a left eigenvector of W(g) with 
eigenvalue —tf)(g). Thus, the diagonal elements of W aux are simply (C|W aux |C) = 

Two comments are in order. Firstly, if the bias in (|2 4|) uses an observable At in 
place of Bt, the auxiliary rates are modified to 

W aux (C -> C) = (C|W aux |C) = u(C)W(C -> C)e~ 9a(c '' c) — l — . (2-19) 

u(C) 

Secondly, applying this generalised result to an ensemble biased by the total shear, 
one obtains the result of EvansP we identify our u(C) with his e qc , where qc is 
defined as a measure of "the propensity [of configuration C] to exhibit flux in the 
future", via = lim^^ ^ ^ c ,(C'|e w ^*' \C) = u{C)/(U\ss) oc u(C). 

We also note that |TTI) = Y,c P™ ( C )\ C ) is a ri S ht eigenvector of W aux with 
eigenvalue zero, and we identify this as the steady state distribution of the auxiliary 
model, consistent with our assertion that the steady state trajectories of the auxiliary 
model are those of the biased ensemble of fj2-4[) in the TTI regime. 

To demonstrate that the auxiliary model is valid, we now need to show that 
this correspondence holds for all trajectories and not simply for the steady state 
distribution over configurations. Consider, then, the probability that a given path 
occurs within the TTI regime of the biased ensemble. We define the path ir by 
discretising time in the manner of a path integral. That is, we state the configuration 
of the system at a sequence of equally-spaced times: taking the spacing At to zero 
then allows us to specify the path with arbitrary precision. Let the sequence of 
configurations be Co,Ci, . . . , Cm, where Co occurs at a time to so that Cm occurs 
at time to + MAt. To ensure that we are in the TTI regime we take r <C to an d 
r <C t — (to + MAt). Then, the probability of the path ir in the biased ensemble is 
simply 

1 |" M 



Y, G c,c M {t-t Q -MAt) 



(2-20) 

where G c ,c>(?) = (C|e w ^)*' \C>) is akin to a propagator in the biased ensemble and 
p ss (C) was defined above to be the probability of observing configuration C in the 
(unbiased) steady state of the original model. We emphasise that this representation 
of the path-probability does not correspond directly to a Markov chain since Gcfi'if) 
is not a stochastic matrix Gc,c' 7^ 1 because W(g) is not a stochastic master 
operator] . 

Then, within the TTI regime of the biased ensemble, we have from f|2- 12|) that 

M 1 



P[n,g] « u(C M ) 
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where the approximate equality is exact in the TTI regime, with the exponentially 
small corrections given in (|2- 12j) . Finally, we define the propagator of the auxiliary 
model, and using the definition of W aux , we have 



This represents a stochastic propagator, in the sense that ^Zc^c^C'^) = 1- Thus, 
the path probability in the biased ensemble is 



where the approximate equality is exact in the TTI regime, as above. We recognise 
the right hand side of (|2 23|) as the path probability for the (stochastic) auxiliary 
model in its steady state. 

Thus, we have shown that the steady state associated with the biased ensemble 
of trajectories can be interpreted as the steady state of an auxiliary stochastic model 
that is Markov and TTI. Transition rates that are non-zero in the original model are 
also non-zero in the auxiliary model, and vice versa. (For example, if the original 
model has only single spin flip moves then so does the auxiliary model, and if some 
moves are forbidden by kinetic constraints in the original modeP^'^ then these 
constraints are preserved in the auxiliary model.) However, we note that the auxiliary 
model may be unphysical in the sense that the dynamical rules are non-local. For 
example, in stochastic spin models the rate for flipping a given spin typically depends 
only on the states of that spin and of a few spins in its neighbourhood. Even if the 
original model W is constructed in this way, the auxiliary model W aux typically does 
not share this feature. In general, it is not clear if such non-local interactions render 
these biased ensembles unphysical, or if they might arise from non-trivial fluctuation 
forces in non-equilibrium states, as proposed by Evans.^ 

We end this section with a note about causality: if we consider an unbiased 
ensemble of trajectories that begins at equilibrium but is perturbed (by a change in 
its transition rates) at some time t w , then the response to the perturbation is zero for 
all times t' < t w . However, if we then use these perturbed trajectories to generate 
a biased ensemble as in (|2-4p . then one will generically observe a response to the 
perturbation for times t' < t w . This is the violation of causality that was mentioned 
in the introduction. Clearly then, a perturbation to the original transition rates 
at time i w cannot be taken into account through a perturbation at time t w in the 
auxiliary model. 

2.3. Time-reversal invariance and a variational result 

So far, we have considered a general stochastic model. We now focus on en- 
sembles of trajectories that are time-reversal invariant. For the unbiased ensemble 
of trajectories, this condition is met for stochastic models obeying detailed balance: 
W(C ->■ COe-W) = W{C -> C)e~ pE ^ where E(C) is the energy of configura- 
tion C, and f3 is the inverse temperature, as above. In this case, biased ensembles 






(2-23) 



jj=i 



8 



R. L. Jack and P. Sollich 



of trajectories defined as in fj2-4[) are also time-reversal invariant, and the operator 
W(g) may be symmetrised by a similarity transformation: 

W(g) = e^/ 2 W( 5 )e-^/ 2 (2-24) 

where E is the (diagonal) energy operator. Such a symmetrisation is possible because 
the bias introduced in (j2-4|) is itself time-reversal symmetric. One may also consider 
biasing ensembles according to observables At defined as in (|2 3|) . In this case, if 
the unbiased model obeys detailed balance then the biased ensemble is time-reversal 
symmetric only if the bias is also time-reversal symmetric: a(C,C) = a(C',C). An 
example is the case where At is simply the number of configuration changes in the 
trajectory, with a(C,C) = 1 for all pairs of distinct configurations. However, if At is 
a current or a flux then time-reversal symmetry is typically broken, and W(<?) may 
not be symmetrised. 

We also note that if the rates W(C — > C) obey detailed balance then so do the 
rates of the auxiliary model. Since M(g) is symmetric, the left and right eigenvectors 
of W(g) are related through v(C) = u(C)e~ l3E ( c \ Expressing M(g) in terms of W aux 
and multiplying it from both sides first by e~@ E / 2 and then by U also shows that 
is symmetric, i.e. 

W aux (C' _> C)u{C')v{C) = W aux (C -»■ C')u{C)v(C) (2-25) 

Thus, the auxiliary rates l^ aux (C — > C) obey detailed balance with respect to the 
steady state distribution p TTl (C) defined above, as claimed. We therefore define an 
auxiliary energy function E aux through 



e 



-pe^ho = u{c)v{c) = e -mc) u(c) 2 (2 . 26) 



so that the difference in the energy of a configuration between unbiased and auxiliary 
models is E aux (C) - E(C) = (-2//3) In u(C). 

We emphasise that the transition rates in the auxiliary model can be obtained 
from the rates of the original model using only the auxiliary energy function as 
additional information. Further, since the operator M(g) is symmetric, one may 
obtain the dynamical free energy through a variational principle 

— ip{g) = max — — — — (2-27) 



with equality when \<p) = Y^c \Af(C)u(C) |C). This may be interpreted as an extrem- 
isation over variational estimates for the steady state distribution through \<p) = 
v/p TO (C)|C)i with equality when p var (C) = p TTI (C). Equivalently, one may con- 
sider an extremisation over energy functions \<j>) = Y.c e ~ PE ™ {C),2 \ C ) with equality 
when E va,v (C) = i? aux (C). However, as noted above, models with short-ranged inter- 
actions have energy functions consisting of sums over local contributions, but there 
is no reason to suppose that i? aux (C) can be written in this way. A specific example 
will be given in the next section. 
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§3. Id Glauber-Ising chain, and link with quantum-Ising chain 

To illustrate the general features described above, we consider the Id Glauber- 
Ising chain. We take a periodic chain of N Ising spins, Sj = ±1 with an energy 
function E = — \ J2i •SjSi+i- Spins flip with Glauber rates, respecting detailed bal- 
ance: the rate for flipping spin i is Wj = [1 + exp(/ijSj)] -1 where hi = /3(sj_i + Sj+i). 
It will also be useful to define domain wall variables n i+ i = |(1 — SjSj+i), so that 

re- , i = 1 if there is a domain wall between sites i and i+1 while re,- , i = otherwise. 

i-t 2 i-r 2 

Periodic boundaries ensure that the total number of domain walls in the system is 
even, while we note that every configuration of the domain walls corresponds to two 
different configurations of the spins, related by flipping all of the spins at once. In 
terms of the domain wall variables, the energy is simply E = X^i( n i+i — §)■ 

3.1. Large deviations of the energy and a dynamical phase transition 

Starting from the Glauber-Ising chain, we define a biased ensemble of trajectories 
as in (|2-4p . taking the observable B(t) to be the energy E(t). We write the master 
equation in terms of domain- wall variables, respresenting states by associating a 
spin-half degree of freedom with each bond on the chain. Thus, a domain wall on 
bond i + \ corresponds to an up spin, while bonds with n i , i = correspond to 
down spins. Then, the operator (|2-8p for the biased ensemble has a representation 
in terms of Pauli matrices o~ x , , o~ y , , o~ z , : 

+(X-l-g)a z i+1 _-l] (3-1) 
with <rti= i ±[cjV i) as usual > 7 = 2/(l + e~ 2/3 ) and A = 2- 7 = 2/(l + e 2/3 ). 

l+ 2 l+ 2 1+2 

We note that large deviations of the energy in a similar model with an antiferromag- 
netic interaction potential may be obtained by taking j3 < and flipping the sign of 
g (since E = +i J2i s i s i+i m that case). Symmetrising W(<?) as in (|2-24|) . one may 
diagonalise M.(g) using a Jordan- Wigner transformation (as, for example, in section 
4.2 of Ref-CED, leading to 



M (s0 = ^2 M k (c k c\ - c\c k ) - - 



k 



(3-2) 



where and c are fermionic creation and annihilation operators, labelled by a wave 

N 
2 



vector k = 2mir/N, the sum runs over integer m in the first Brillouin zone, — ^ < 



m < y> an d 



Q k = J ( g - A + 1 - cos k) 2 + A7 sin 2 k. (3-3) 



We have Q k > so that the largest eigenvalue of EI is —ip(g) = J2 k (^k — \)- The 
fermion vacuum state has such an eigenvalue, and we identify the difference between 
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the largest and next-largest eigenvalues as Auj = minfc(2i?fc). Finally, taking the 
limit of large system size, 

N f w c\k 

</>(<?) = y J 2^(1 -20*) ( 34 ) 




Fig. 1. Dynamical phase diagram for the Id Glauber-Ising chain, as a function of biasing parameter 
g. Solid lines correspond to second-order (critical) phase transitions. (Left) We show the 
behaviour as a function of inverse temperature /3: the regime with ft < corresponds to an 
antiferromagnetic chain, while /3 = is the chain at infinite temperature. The equilibrium 
steady state corresponds to g = and is always paramagnetic (PM). Large positive g drives the 
system into a ferromagnetic (FM) phase while large negative g leads to an antiferromagnetic 
(AFM) phase. On the right, we show the same figure as a function of temperature, to emphasise 
that both transitions persist all the way to T = 0. However, the nature of the critical points 
changes at T — since the system is no longer time-reversal symmetric. 

As well as the dynamical free energy ip(g), we emphasise that we have obtained 
the full spectrum of the operator W(g). A particularly important case for large 
system sizes is obtained when min^ = 0, so that there are eigenvalues of W(g) 
that are arbitrarily close to its maximal eigenvalue —ip{g). The essential point here 
is that fik > except in certain special cases: (i) when k = and g = A, (ii) when 
k = tt and g = —7 (recall 7 + A = 2) and (hi) when A = is equal to zero and 
cos/c = 1 + g (or 7 = and cos A; = g — 1). Case (hi) corresponds to the zero- 
temperature dynamics of the Ising model, which we do not consider in this work. 
However, we will consider the cases g = 7 > and g = —A < 0, for which the system 
becomes critical. It may be verified that the second derivative of ip{g) diverges 
at these critical points (note that we have taken this derivative after the limit of 
large N). This divergence signals a (continuous) phase transition in the space of 
trajectories. In particular, (|2-12p breaks down, and the existence of the TTI regime 
described in Section 12.21 is no longer assured (this point will be discussed further in 
Sec. 13.31 below). 

Now, the Id Ising model clearly has no phase transition at any hnite temper- 
ature, so the equilibrium ensembles of trajectories with g = are those of ergodic 
paramagnets. However, for g > A, the biased ensembles of trajectories are dominated 
by ferromagnetic configurations: the system acquires long-ranged order in space, and 
it also breaks ergodicity, exhibiting long-ranged order in time. A similar effect occurs 



Large deviations in stochastic models 



11 



for g < —7, for which the system enters an antiferromagnetic state. The 'dynamical 
phase diagram' for this system is shown in Fig. [TJ Similar critical phase transitions 
in biased ensembles have been found in higher-dimensional ferromagnets, for tem- 
peratures above their critical pointsP^'^ However, to explain how the physical 
conclusions described in this section can be drawn directly from the form of W(g), 
we now show that biased ensembles of trajectories in the Id Ising chain have already 
been studied extensively in the context of quantum phase transitions.^ This allows 
us to identify the universality class of the (continuous) phase transitions at g = 7 
and g = —A: as long as we take T > in the stochastic model, this is the universality 
class of the (classical) 2d Ising model. 

3.2. Link with quantum Lsing model in a transverse field and hence with the 2d Lsing 
model 

We begin by taking (3 = in the original Ising chain, corresponding to infinite 
temperature, so that all single spin-flip transitions take place with rate ^. In this 
case, we have, using the superscript (n) to emphasize that we are in the domain wall 
basis, 

eW( 5 ) = wW( 5 ) = \ £ \^t\ ~ 1 - <J ( 3 - 5 ) 

i 

One may also work in the spin basis, using a spin-half degree of freedom for each of 
the original Ising spins: for (3 = 0, one has a master operator 

H (s) (9) = WMfc) = \ [of ~ 1 + A] (3-6) 

i 

These operators are familiar from studies of quantum spin chains. To be precise, 
[— H( s )((7)] is the Hamiltonian for an Ising ferromagnet in transverse field, a canonical 
model for quantum phase transitions (QPTs)P^ In [— H( s ) (g)] , one identifies g as an 
Ising coupling between spins, while the term proportional to a x is a 'transverse field' 
that frustrates ferromagnetic ordering. As g is tuned through g = 1, the ground state 
energy ip(g) has a singularity, and the system acquires long-ranged ferromagnetic 
order. The point g = 1 is critical in that it exhibits a diverging correlation length.^ 
Representing the partition function for the quantum system as an imaginary time 
path integral, one sums over an ensemble of periodic trajectories of the Ising chain. 
The temporal extent of these trajectories is given by I3qK where (5q is the inverse 
temperature of the quantum system and h is Planck's constant divided by 2tt. In 
the limit of large /3q (small temperature in the quantum system) , one may consider 
paths of length MAt <C I3qH and show that the (real- valued) weight associated with 
a path 7r in the quantum path integral is proportional to the path probability in the 
biased ensemble of the Glauber- Ising chain, defined as in (|2-20p . [The constant of 
proportionality is simply the partition function Z(g,t).] 

Further, the dynamical free energy ip(g) can also be identified as the thermody- 
namic free energy of a two-dimensional Ising model on a square lattice. To arrive at 
this standard result,^ consider a 2d Ising model with energy E = — Ylij(J s ij s i+i,j + 
KsijSij+i) where the Ising spins Sij now carry two indices, indicating their co- 
ordinates on a square lattice. Starting from a system with J = K, one may take the 
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lattice spacing in the y-direction to zero, with the couplings J and K being adjusted 
to keep a constant free energy density. The result is a model with a continuous y co- 
ordinate: one then identifies this co-ordinate with the time t in the quantum model 
or the Glauber-Ising chain.® Comparing (|3-5p and (|3-6p . there is clearly a duality 
between models with biasing parameters g and 1 / g: the mapping to the square lat- 
tice Ising model allows us to identify this as the Kramers- Wannier duality of the 2d 
Ising model. We note in passing that while the free-fermion solution for the large 
deviation function ip{g) is possible only for the Id Glauber-Ising model, the mapping 
from a d-dimensional Glauber-Ising model to a (i-dimensional quantum spin model 
applies in all dimensions, and the critical properties of these (i-dimensional models 
are the same as those of a d + 1-dimensional classical Ising model.® (However, the 
mapping in d > 1 takes place at the level of an effective field theory, so it applies 
only to universal quantities.) 

If one now works at finite temperature for the Glauber-Ising chain, one obtains 
H.( n \g) by symmetrising the operator W^ n \g) given in (|3-ip . and one may also write 
down the operators W"(j) and H.( s \g). Compared to the infinite temperature 
case, the symmetrised operators contain extra terms, but these are all irrelevant in 
the renormalisation group sense. It follows that for T > 0, the dynamical phase 
transitions shown in Fig. [T] are in the universality class of the quantum- Ising chain 
or, equivalently, the 2d Ising model. 

Finally, we note that these mappings break down in the special case where 
T = in the Glauber-Ising chain: this model corresponds to a reaction-diffusion 
system A + A —> 0. This is a non-equilibrium critical system in the sense that 
the decay of finite-density initial conditions towards the ground state occurs in a 
power-law fashion and involves a dynamical scaling length that grows as a power of 
the time. In this case, detailed balance is not obeyed and the operator W(<?) may 
not be symmetrised. However, the model may still be solved by free fermions and 
the phase diagrams show that paramagnetic, ferromagnetic and antiferromagnetic 
phases may all be observed at zero temperature. We postpone a discussion of these 
biased enembles to a later study. 

3.3. Physical interpretation of the biased ensemble in the Glauber-Ising chain 

It follows from the above analysis that if we take a large Glauber-Ising chain 
and select long trajectories with a small value of the time-integrated energy, this 
ensemble is dominated by ferromagnetic trajectories that spontaneously break the Z2 
symmetry of the Ising chain. To understand the effects of this symmetry breaking, 
It is instructive to consider the master operator in the basis of the original Ising 
spins. The paramagnetic phase corresponds to a non-degenerate largest eigenvalue of 
W^ s ) (g) and (|3-3p indicates that there is a finite gap between the largest and second- 
largest eigenvalues. Thus, (|2-12p holds, and the analysis of Sec. 12.21 follows. On the 
other hand, at the critical point, there is no gap in the spectrum, and both (|2-12p and 
the TTI regime break down (for large system size N). Then, in the ferromagnetic 
phase, spontaneous symmetry breaking means that the largest eigenvalue of (g) 
is now doubly degenerate, but all other eigenvalues are separated from these two by 
a finite gap. In that case, (|2-12|) may be generalised into a projection onto the lowest 
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two eigenvectors of W^(g'), and the existence of a TTI regime may again be proven. 
This illustrates the point that we made in Sec. 12.21 that a non-degenerate largest 
eigenvalue of W(g) is sufficient to ensure the existence of a TTI regime, but it is not 
necessary. 

Furthermore, from the analysis of Section [21 the ensemble of trajectories that 
we have defined here by biasing the time-integrated energy can also be generated by 
an auxiliary (Markov) stochastic model that respects detailed balance with respect 
to its steady-state distribution. Since Id systems with short-ranged interactions do 
not permit ferromagnetic states, it follows that the effective energy function .E aux 
associated with the auxiliary model must contain long-ranged interactions. In fact, 
the form of E aux has been discussed quite extensively in the mathematical physics 
literature for the closely-related case of a single-layer in a 2d Ising model on a square 
latticed 

§4. Conclusion 

In this article, we have brought together several results for biased ensembles, 
defined as in (|2-4p . Our main interest concerns the degree to which these ensembles 
represent physically-reasonable dynamics that might be sampled by some experi- 
mental procedure. 

For general biased ensembles, we showed that one may always construct an 
auxiliary Markov process whose steady state reproduces the TTI regime of the biased 
ensembles. Transition rates in the auxiliary models are modified from their original 
values by factors that depend only on a single left-eigenvector of a master operator 
W(g). (Of course, obtaining this eigenvector is likely to be impossible except in 
relatively simple exactly-soluble models). In any case, the biased ensembles are 
Markov, although the rates for local processes may depend on configurations of the 
system in far away regions. 

For biased ensembles that respect time-reversal symmetry, we showed that this 
auxiliary Markov process may always be constructed in terms of an auxiliary energy 
function, and we established a variational bound on this energy function. However, it 
is likely that this auxiliary energy function typically contains non-local interactions. 
The presence of such interactions is proven for the Glauber-Ising chain since the 
model undergoes a phase transition to a ferromagnetic state. 

The crucial question arising from Refs. [TU|).llip is whether the presence of phase 
transitions in biased ensembles of trajectories can be used to explain the properties 
of the original (unbiased) stochastic model. In the Ising chain, one may intepret 
the low temperature behaviour in terms of patches of the two ferromagnetic phases, 
while noting that large enough ferromagnetic domains are always unstable to thermal 
fluctuations. We have shown that biased ensembles of trajectories can stabilise the 
ferromagnetic phases, and reveal the symmetry between them. In the context of 
the glass transition, one might argue that biased ensembles are similarly effective in 
revealing states that are eventually unstable to thermal fluctuations, but nonetheless 
persist for long enough to explain the large relaxation times observed in glass-forming 
liquids. It would certainly be very interesting to understand what terms appear in 
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the auxiliary energy function as glassy systems break ergodicity, and to study how 
these interactions stabilise the amorphous solid phase. 
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